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PREFACE 



On Dec^nber 1973, Abt Associates Inc. contracted with Extension 
Service, USDA, t6 conduct an evaluation of a 4-H .television series on" 
nutrition called Mulligan Stew .^ This six-part: series, targieted to "^th, Sth-, 
and 6th grade children, had been ^^own on local television stations across 
the nation during the year preceding the evaluation . '.While some states had 
conducted pilot studies or mini-studies on the impact of the series no con- 
trolled national field study had been applied. The present report describes 
such a study. Conducted on over 3,000 school-aged .children in six, states, 
the study documents changes in nutrition-related knowledge and behaviors 
which -can be related to articipating in the Mulligan Stew series. This 
final report is a description of the study and its fifidings. 



The report consists of four volumes: 

^ Volume I, -the Executive Summary, focuses on findings and recoinmenda- 

tions. This summary is organized to give the reader a quick overview of > the 
main findings of the study. " , f ^ 

Volume II, Report of the' Study, is a detailed elaboration^ of the 
study findings as well as a description of study design, instrumentation j 
and procedures. 

Volume III, Case Studies, is a descriptive report^ of visits to i:he 
six study states 'to. elicit information on the delivery system and costs 
associated \^ith' the program. ^ 

Volume^ IV, Documentation, is a reference volume containing all prior 
reports, submissions, computer printouts and supporting data for the study. 

Many Individuals contributed to this; effort. .At Abt Associates Inc. 
the contract staff included the following: * 

> S. Shapiro, Project Director 

R. L. Balei Deputy Project Director - . 
* V. Sccirdino, Deputy Project Director . .. 

^ . . L. Abrams, Analyst 

./ T. Cerva, Analyst ^ . ^ 

.^M. Conti, Analyst ; - / 

/ K. Hewett, Analyst * 

\/ D. Thomson, Analyst 

/ J. Dwyer, Ph.D., Consultant 

V. Horner, (Ph.D. , Consultant 

A. Ziolkov$ki, Secr^ary^" 



The core staff (Bale, Cerva, Scardino) has been as,sociated with 
the project and has worked closely with the project director from the 
beginning. A teaih approach was maintained* throughout; 1|hat is, the dore 
staff was intimately involved 'in -all aspects of/the study. Each of them •. 
also took on 'specific responsibilities as weMT 

. Dick Bale engineered the site selections and initial field visits , 

as well as the double fallings required in the field ^±f%rt. In addition, 
his conceptualization of the analytic approach served as the model for 
the specific analysis undertaken. , . . ^ * 

Virice Scardino had heavy input into the design of the instruments 
and was in (charge of check --in, coding, and editing of the student pre- and 1 
post-test irjstruments. . V , 

Tom -Cerva -developed the prototype case study and was senior pro- 
grammer for the impact evaluation. All computer runs other than- the cross- 
tabulations were programmed and run by him. 

Day Thomson, wbo joined the project for the cai^e stud^j^ vii^sits, has 
acted as coordinator of the case sfetiG(ies as well as preparing statj|5tical 
summary tables from the cross tabulations. 

"*.,■ -*'• 

The staff with the able assistance of Ms. Ziolkowski has worked as 
a team in the writing and production of this \ final report. However, some 
concentration of effort was planned. Thus Vince Scardino focused on the 
Executive Suiranaxy; Ms. Thomson's efforts were primarily \a4dressed to the V 
Case Study volume; and T. Cerva, R. Bale,^and^S. Shapirp produced Volume II, 
Report of the Study'. All products were jg|viewed by S^. 'Shapiro, project 
director,, before submission.' ^ ~ 



Evaluative research teftds- to be conducted by a study team. This 
study was no exception. Whatf has beer} exceptional is the support and on- 
going interest of the staff of Extension Service, USDA throughout the- ten 
months of ,the study. Ms. Eleanor Wilson, project officer, and Drs. Evelyn 
Sgindler and Claude Bennett, who worked with her as the Extension Service^ 
Committee' on this project, were admi2^able colleagues in the effort. While 
Abt Associates Inc. must take final respoj^sibility for this report, it 
owes much to the committee members, who functioned not only as reveiwers 
but as contributors ^t critical points during the contract period. 

In addition, Ms. Wilson, through her personal diplomacy, smoothed 
the way for us and by so doing helped to keep the study on schedule. We 
are grateful for the experience of working so productively wit^ .Extension 
Service. ^ Of) 

Sydelle Stone Shapiro, Ph.D. . 
' Project Director 

( October 15, 1974 
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INTRODUCTION 



Cn 1972 the USDA Extension Service produced a series of six half- 
hour TV shows desigfned to teach youth about^nutrition^ This 4~H TV series 
was produced as a cc«nponent of the ExpTanded Food & Nutrition Program (EFNEP) , 
and was.calje(^ Mulligan Stew . Each* of the six film productions depicts 
Mulligan and his friends, the Mulligan Stew gang, in a variety. of situations 
^dealing with nutrition. 'Each of the films emphasizes a diffeijint aspect of 
nutrition and is'' a self-contained unit. Yet basic nutrition concfept 
identified and repeated througliout the entire series. j 



Dts are 



:ilm^, 



To supplement the six film^, support materials were prepared. 
Materials for group leaders includeid suggestions for activities whic h wou 
reinforce the, message of the f i]«&-. Materials for yoCith included a 
Mulligan Stew comic/workbook. 



■. " While the main goal of the series is to help youth acquire and apply 
nutrition knowledge, Mulligan Stew has several other objed'tives. These in- 
elude increasing nutrition-related activities (e.g., shopping for food) ; 
and increasing youth's awareness of 4-H, an imporljant secondary objective. 

• During the 1972^73" school, year , the Mullicfan Stew series was , shown 

in classrooms, at 4-H clubs, on educational television, and pn local commer- 
/cial stations.- But although limited research was conducted on the series, 
there was nq broad^based Evaluation designed to answer many important questions 
concerning the effectiveness of the series. 



This report documents the results of a broad impact evaluation study 
bf the effectiveness of the Mulligan Stew series, with suggestions for 
"possible futllre TV projects for the Extension Service. 
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DESIGN OF ^THE STUDY 



The evaluation, was ccpncjuc/ted iri the early part (>f 1974 among more 
than 3dOp youth in the 4th, Sth^ and Gtlv-grade^ in six states:' Arkansas, 
Missouri, Oregon, Pennsylvania^, -Tennessee, arid Texas. A ^ro/post experi- 
mental design was utilized ,J'Where the pre-wave of data was gathered just 
before youth began watching the Mulligan Stew shows,, and the po'st-waT^e was 
conducted within a few days after the last show was teleyised. Arrange- 
ments for testing were made through schools by The State Extension Services. 
Iri order to gather "^information on the relative effectiveness of Mulligan , 
Stew under different 'situations, a number of experimental groups exposed 
to the films) and control groups (not exposed) wfere. used. The following 
table summarizes the various experimental and control 'conditions and the 



total number of youth 



[i pdxtici 



ipating in each conditipn. 



SUMMARY DESCRIPTION OF 
EXPERI^NTAL AND CONTROL GROUPS 



1. Watched MiAligan Stew IN-SCHOOL and 
Used the Comic Book . 



No . of Vouti^ ' 
' y 

539 . ' 



2. -Watched Mulligan Stew IN-SCHOOL, but 
Without Comic Book 



482 



Watched Mulligan Stew AT-HOME and 
Used the Comic Book 



398 



4. Watched l^ulligan Stew AT-HOME, but 
Without Comic Boak 



404 



'otal Experimental Group Youth ' v 



. 1,823 



Control^J^oup. I did not watch 
Mulligan Stew and dicj^not use Comic 
Book; Tested pre- and post 



375 



6. Control Group II did-not watch 

Mulligan Stew , and did not' use Comp.c 
Bo5>k; Post tested 'only * ^ 

Tojbal Control Group Youth 

Total Youth Analyzed . ^j 



373 



748 , 
2*571'' 

T 



^t should be noted that although _jtpre ^han 3,000 children participated in 
either the pretest or post-test,' a number of children were dropped from, 
the data analysis because they were absjent when; either, the pretest or the 
post-test was givep. ^"^^ ^ 



The rationale for, this design is as follows'. The application of 
jDOtK pre- arid post-viewing measurements to. the experimental groups en- 
' ables us to address the question of whether there are changes in the nutri- 
tion behavior, nutrition knowledge, attitudes and awareness of 4-H after 
viewing the. Mulligan Stew series- Without this pretest/post-test comp" .t- 
son, ther/* would be no defensible ba&is for assessing such change, 

' One, of the control groups unexposed to the shows received both the 
pretest and post-test to provide the basic standard against which the changes 
observed. in the experimental (exposed) groups could be compared. (Obviously, 
if th^se control youth demonstrated- the same kinds and degree of change in 
nutrition-related activities, knowledge ai(d , attitudes as did the experimental 
groups, it »would be impossible to conclude that viewing ^Mulligan Stew had 
caused these changes •) 

.: . ^ _ . . 

The second vtype of controlj gro^R ~ those youth who did not see 
Mulligan Stew and who were tested oWly dicing "the post-testing phase of the 
study — protected against a different kind\of problem:. One might argue that 
the control youth who received the pretest wei^e«.se^itized by pretesting — 
that is, the pretest itself aroused sufficient c^iousity in these youth. to 
cause many of them to seek.out cofrect answers to the knowledge test, etc. ~ 
an4 thus -would automatically improye on the post-test. This would reduce 
. the apparent effectiveness of Mulligan Stew, , when in fact" it was the mea- . 
surement process that caused spurious changes. (It may^e noted that the 
Post Only Control data suggests that there wasn't any sensitization and 
. therefore are not' dd^scussed separately in this volume.) 



Each of t»he"d9fo^s">s"*^^°"^'^ groups contained approximately equal 
numbers of four||^, fifth*, and sixth grade youth and, to the extent 
possible, the de^gn wiis replicated in each of the six states used for 
the study. As can be seen in the following table, the experimental and, 
coptr'ol youth are well matched on most key demographic characteristics.. 
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DEMOGRAPHIC OHARfeCTERISTICS OF EXPERIMENTAiiS 
AND GON^ROLa (ALL GRADES COMBINED)/ 



(BASE: Santpie Size = 100%)^ 

SEX ^ 

Male , ' ' 

Female 

AGE <^ 



9 or younger 
10 
11 
12 

13 or older 
Not r^orted 
READING LEVEL 



Below grade level 

At or abbve grade level 

Not reported 

ESTIMATED ANNUAL C 
FAMILY INCOME 

Under $5,000 per year 

$5,Q00 - $ia>000 per year 

Over $10,000 per year - 

Not reported 

ethnic/raciAl 

White 
Black 

Spanish Surname 
All others 
Not reported 



Experimental 
Group 

' (1.823) 



65 
6 



28% 
33 
33 
6* 

62% 

8 
23 

1 

6 



Pre/Post 

Control 

Group 

(375) 




35% 
56 
9 



^25% 
48', 
18 
7 

60% ' 

12 

18 

1 

9 



In' the pre-testing and post-testing phases of the^ impact Valua- 
tion \he children filled out test booklets which explored tjieir knowledge 
of nutritioi*, thei| activities related to nutrition, and their awareness 
of and interest in 4-H. Additionally, children were asked 9n the post- 
test^about 'their reactions to the Mulligan Stew films, 

:> 

In order to answer the many ^uestionX^round which the impact 
study was originally formulated, seventy out cohie measures were constructed 
and analyzed for dif f eifeh^sfes between various expgrimental and control youth - 
These seven outcome measures, listed below, willfbe discussed in the next 





Ij percent increase in nutrition knbw2,e 
2) percent increase in nutrition- 
3>^^ percent change to preference for 

4) percent reduction in preference/ 

5) percent change to eating breaki 
5) percent change to learning from peers 

and 7) ^ percent change in awareness of 4-h;. 

The statistical tool used in analyzing these data was the test of 
significance for a difference between proportions (percents) , We usfed the^ 
99% significance level for analyzing differences between the group^^hat. is 
99 times out of 100 the differences rtoted aye real differences between the 
groups/' (and are not due to chance variation^ . 

As is the case v^h most^ research efforts, there are limitations 
in the data; trade-oft s had to be made concerning the information which ^ 
would be most helpful in* answering important questions^concerning Mulligan ^ 
Stew' s effectiveness within the budgetary and time constraints of the study^* 
For example, this study can not make any direct statements concerning 
"Stew's" impact on 4-H groups since w^ were not able to locate- such groups 
at each ^of. the six sites that could participate in the experiment during 
the scheduled field da^. . Also, time constraints prevented any long-range 
impact-" to be assessed ^Pnce our post testing of youth rwas c(4iducted immed- 
iately after the sixth show. Thirdly, a proxy measure for nutrition be- . 
havior had to be* utilized bec^^us^ of the prohibitive costs of actual ob- 
servation of eating 'habits on a large scale. Further, no data was collected 



This.te^t is- described in J. Cohen's Statistical Power Analysis for the 
Behavioral Sciences (New York: Academic tress, ,1969), c^n pages 174-205 r 
and involves employing an arcsine transformation of ^the proportions, in. 
ordffer^ to normalize th^ distributions. - . . ^ , , 



on the parents of the youth participating in the stucjy because of budgetary 
considerations, even though it is recognized that the parents are inflportant 
faotors^ in- a child's nutrition habits. Lastly, because of the difficulty 
of Obtaining reliable income' data from teachers about the child's family, 
our data analysis did not focus oh detecting differences by family income/. 
Thus the reader should recognize *that th;Ls study cannot answ^ every quesr 

tion that n^ight be - conceivably aske4 abo\it Mulligari Stew's impacty 

' w . ■ ' ^ ! ' . ■ ■ ■ . 

While the main focus of , the study was on the youth involved , therfe^ 
was also considerable interest in the effect of 'the series on the ceachers. 
Thus information and reaction^ were sought f rom^ the teachers participating 
^in the -project. * -* 

In order to gather ructions frgm state Extension Service personnel 
who were involved in the delivery aiSi distribution of the Mulligan Stew 
series, the research sta^ working on the project at Abt Associates made 
personal visits to the various program sites. The cost data gathered from 
each state did not xinjdergo rigorous statistical treatment, but is presented 
in. a descriptive analysis of the data. ^ 

And finally, in order to determine the strengths and weedcnesses of 
the series and to suggest possible improvements, the entire package was 
subjected to a content analysis of each of its various components. 
This analysis is qualitative in nature, and contains criticisms ' and sugges- 
tions for future efforts. 

The remainder of this voliome contains a summary of the findings 
and recommendations made by Abt Associates on the Mulligan Stew project. 
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SUMMARY pF RESULTS 

■ ■ . ' 

/ 

» IMPACT FINDIN G — OVERAIZi . . - 
: ' 

X THERE IS ;V POSITIVE IMPACT ON^YOUTH WHO PARTICIPATED IN THE 
"MULLIGAN STEW SERl£S. ' ' - 



'This overall, finding on Mulligan Stew's impact is based upon our 
^''an^lysis of fourth grade, fifth grade , and sixth grade youth in each of • 
the. experimental on each of the seven outcome measures (described in the 
previous chapter).- The tjable below summarizes our findings for -all grades 
combined on the seven outcome measures, and demonstrates that "Stew" has an 
impact on youth in most; though not all, of the measurement areas. (Through- 
. out-this chapter aa asterisk (*) has been used to indicate that the Experimen- 
tal Group is significantly different from its corresponding control group at 
the 99% level of confidence.)" 

TABLE 1 



SUMMARY TABLE' OF STEW'S IMPACT 



1) 



Percent increase it( nutritf6n 
knowledge from pre -to post 

Percent increase in nutrition- 
related ip^haviors from pre 
to ,post ' 

Percent change in preference for 
adequate diets from pre to post 

Percent reduction in preference 
ratio of "empty calorie" to 
nutritious foods from pre to post 

Percentj^hange to eating breakfast] 
^. from pie to post 

Percent change to learning from 
peers from pre to post 

Percent change in awareness of 4-H 
from pre to post ^ 



Experimental Control Grotip " 
Grp^p;v(¥Sirti- . (Did Not 
cip^l:^- in Participate in 
Mulligan Stew ) Mulligan Stew) 



27% 



3% 



19% 



7% 



53% 



38% 



59% 



5% 



-4% 



17% 



-3% 



35% 



27% 



24% 



4 



1) 



All data presented in this summary table* combine all grades and thus have been 
adjusted to equalize the number of youth in each grade. 
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' • IMPACT FINDING — NUTRITION lOJOWLEDGE 

MULLIGAN STEW IS UI^hY EFFgdriVE IN INCREASINg Y^TH ' S KNOW- 
LEDGE OF NUTRITION. 

^ ■ ' / • 

The outcome xt\,easw^!^ for this impact area — the percent increase 
from pretest to post-test/' in. the mean number of correct ^answers to the gen- 



t ^nswei 
dnart I 



eral nutifitiori knowledge, questions -^^ is displayed in Chart I below. As 
*can be readily seen in this qhart, 'all grades show dramatic increase in know 
ledge, as compared to that of the control groups not exposed to the filins. 



/ 



CHART I. INCREASE IN NUTRITION KNOWLEDGE 



Ejperiinental Group 
Control Group 



mmm 



L 



No. of Youth % Increaie in Mean Number Correct on Nutrition Know^ge 

Test, Pretest to Post-Test 



4th Gra(;lers 



5th Graders 



6th Graders 



582 
112 



631 
123 



608 
140 



30% 



3% 



29% 



3% 



22% 



15 



10 
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IMPACT FINlDINq^— NUTRITION-REIATED BEHAVIORS 



THE SERIES ,HAS ONLY A SLIGHT IMPACT ON NUTRITION.-REIATED 
ACTIVITIES ^AMONG 4TH AND 5TH GRADERS. ' . _ ■ ^ 

The- measure jox this impact area — the percent increase (or decrease) 
from pretest. to posl^-test in the number of nutrition-related behaviors, such 
as shopping for fo^^d, helping with family meals, etc, -- is presented in 
Chart II. While fourth and fifth^raders show positive effects, these effects 
are hot lar^ and 6th grade children display erratic results when'^the^ecific 
experimental conditions are analyzed. The most probable explanation for these ^ 
results is that nutrition^related activities 'are not easily changed, even' 
'among younger- c^iiidr en. . 



CHART n. INCREASE IN NUTHITION-RELATED ACTIVITIES ^ 

% Increase (or Decrease) From Pretest to Pott-Test 
No, of Youth In Number of Pyitlve Nutrition*RelatiW Behaviors 



Experimental Group 
Control Group 



7///////. 




4th Graders 



5th Graders 



\ 6th Graders 



582 
.112 



631 
123' 



608 
140 



5%; 



v/////m 



4% 



-3% 



-1% 
-3% 




# . I MP ACf^ .FINDING PREFERENCE FOR ADEQUATE filETS 

/ VIEWING THE' MULLIG^ STEW SERIES HAS NO DISCERNIBLE IMPACT 
ON THp DIETS THAT CHILDREN SELECTED (IN TERMS OF THE 4-4-3-2 
FORMULAf WHEN GIVEN FREE CHOICE ON A.MENU CONTAINING A LARGE 
NUMBER OP" FOODS. ^ , .5 ; ^ 

Twcrtfutcome measures were used as indicatory of impact on youth's 
food intakdS;intentions, The 'first «of these is displayed in Chart III below: 
The percent <^ youth whose post-teiSt preferences in food selection equals 
or exceeds the 4-4-3-2 'diet among those whose diet preference were inadequate 
oh the pretest. ) * ^ ; 



CHART III. CHANGE TO ADEQUATE DIETS 



Experimental Croup 
Control Group ' [ 



. 4th Graders 



5th Graders 



6ih Graders 



No. of 
Youth 



409 

78 



454 
83 



413 
104 




, of Youth Whose^o^Teit Food Selection Preferences Equals orf 
Exceeds the 4-4-3-2 JDiet Among Youth Whose Selection Pref^renc^i 
Were Inadequate on One or More Food Groups on the Pretest^ | 



If 



17% 



] 19% 1 



wmmmmmmmmmmm^ 



J 



18% 
17% 



wmmmmmmmmmmmmm. 



J 14% 



21^, ■', 



17 



12 



> IMPACT FINDING PREFERENCE FOR. "EMPTY CALORIE" BOODS 

VIEWING THE SERIES RESULTS IN A PRONOUNCED REDUCTION . I |f THE 
• PREFERENCE RATIO OF "EMPTY CALORIE" TO NUTRITIOUS F00d| 
SELECTED WHEN GIVEN FREE CHOICE OF A LARGE NUMB^l OFFQODS. 



The second outcome measure 'used in ai>alyzing the youth's foqd intake 
intentions the^percent reduction in the prefer^ce ratio 'of 'Vempty 
calorie"^ to nutri^tioug food selected from pretes^ to post-test — is dis- 
played in Chart IV, It appears" obvious that tfulligan Stew heightens youth's 
awareness of "empty calorie" foods (for example, soda pop and snack chips). 



CHART IV, REDUCTION IN PREF^NCE RATIO FOR "EMPTY CALOf^" F^^ODS 



Experimental Group 
Control Group 



No. of 
Youth 



% of Reduction From Pretest to PosMest in Mfean Pre- 
ference Ratiw of "Empty Calorie" To Nutritious foods 



4th Graders 



5th Graders 



6th Graders 



576 
.112 



625 
123 



601 
140 



wmmmmm. 



3% Increase 



mmmmmm 



3% Increase 



wmmmm 



7% Reduction 



7% Reduction 



7%iFledu6tion 



3% lacrease 



, A 



18 



V 



9 
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IMPACT, FINDING — BREAKFAST-EATING BEHAVIOR 

VIEWING THE MULLIGAN STEW SERIES PROBABLY HAS A POSITIVE EFFECT 
IN TERMS OF INCllEASING THE ' INCIDENCE OF EATING BREAKFAST. HOW- 
'fiVER, THIS OUTCOME SHOULD BE TREATED WITH GAUTION SINCE THE 
SAMPLES ON WHICH THIS FINDING* IS BASED IS SMALL. 



the percent of youth who 



The outcome measure for this impact area — 
ate breakfast the morning of the post-test among youth who did not eat 
breakfast on the morning of the pret^^t ~ is presented, below in Chart V. 
While there is a clear tendency for 4th and 5th grade youth who participated 
in the ^^ries to eat breakfast, these results should be treated cautiously 
because of the small samples involved. ^ 



f 



CHART V. INCREASE IN EATING BREAKFAST 



Experimental Group 
Control Group 



4th Graders 



5th Graders 



6th Graders 



□ 



No. of Youth 



74 
17 



73 
19 



89 
34 



% of Youth Who Ate Breakfast the Morning of the Post-Test 
Among Youth Who Did Not Eat Breakfast on the Moniing of 
the Pretest ^ 



59% 



J 29% 



48% 



32% 



51% 



44% 
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, IMPACT FINDING — "aTTITUDES TOWARD LEARNING ABOUT FOOD FROM 

PEERS - • 

. IN GENERAl/oNLY 4TH^GRADE;FS>SH0WED DEFINITE SAINS OVER THEp 
CONTROL group' QDUNTERPARTS IN ||RMS OF FEELING/ THEY CAN 
LEARN ABOUT FOOD FROM. THE3^ PEERS; 5TH AND eTH GRADE YOUTH 
SHOWED NO SIGNIFICANT GAIN OVER THEIR CONTROLS. 

This outcbme measure — the percent of youth who indicated on the 
post-test they could learn about food from peers among youth who indicated 



^. on the. pretest that they c6uld not learn about food from peers —is dis- 



played in. Chart VI. 



CHART VI. PERPEnVcHANGE^ 



Experimental Group 
Control Group 4 



^ 4th Graders 



5th Graders 



6th Graders 




/ 



D LEARNING FROM PEERS 



W///////// 



105 

' 17 



96 
24 



94 
33^ 



/ 



% of Youth Indicating on Post-Test That They Could LeaJ-n 
Frohi Peers Among Youth Who Indicated on Pretest That They 
Could Not Learn About Food From Peer% 



49% 



29% 



30% 
J 29% 



J 24% 



36% 



29 



ERIC 



15 
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IMPACT FINDING ' — -VIEWING SITUATION 

/ . .. 

ALTHOUGH THE SERIES HAS A GOOD IMPACT IN EITHER VIEWiriG SITUA- 
TION, MULLIGAN STEW HAS A BETTER IMPACT WHEN CHILDREN WATCH IT 
IN SCHOOL THAN WHEN THEY WATCH IT AT HOME. 



{Jviden-tly, ^the dyiiainics of a group viewing situation works in favor 
of Mulligan Stew . Some of the more dramatic -data which led us to this con- 
clusion is displayed on-Chart VII below on two of our impact measures. 
(While some of our other measurements don't demonstrate such differences 
as consistently or-^Sramatically, there is never a reversal in* this trend 
favoring in-schopl viewing. ) One must be cautious in drawing implications 
from this finding, since our experimental design did not permit us to gather 
data from the parents who viewed the series with their children at home or m 
group situations outsido^ the school. 




^-4 
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CHART VIlT IMPACT OF VIEWING SITUATION ON SELECTED MEASUREMENTS 



In-S^hool Viewers 
At-Home Viewers 
Control Group 



No. of Youth 




% Increase In Mean Number Corj^ect on Nutrition Knowledge 
Test, Pretest^to Post-Test 



4th Graders 


329 










253 




Wmmm 


y///////////Am^^^ 




112 




1 3% 




5th Graders ^ 


346. 










285 




mmmm^ 






123 




1 3% 




6th Graders 


344 










264 


« 


W///////////////A 






140 




. 11% 



36% 



36% 



% Reduction From Pretest to Post-Test in Mean Preference 
Ratio of "Empty Calorie" to Nutritious Foods 



4th Graders 



5th Graders , 



6th Graders 



326 
250 
112 

346 , 

279 

123 

338 
263 
140 



CZ 



11% Reduction 
6% Reduction 

9 

3% Increase 



3% Reduction 
3% Increase 



14% Reduction 



Jl% Reduction 

6% Reduction 

3% Increase 



mm 
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THE MULLIGAN STEW COMIC WORKBOOK IS AN IMPORTANT .TOOL THAT 

REINFORCES THE MAIN NUTRITION IDEAS P^SENTED IN THE FILMS . 

/ ' "... . * 

While the films work well without any auxiliary materials. Mulligan 

Stew has a better impact when the youth are provided with the comic workbook. 
Cttart VIII below demonstrates the differences in impact on two selected mea- 
surement areas. (While nqt all measurements display th€ comic vs. no comic 
differences as well as the following chart, the same ^nding still holds 
throughout tjie analysis.). Those youth who had the! gomip workbook and 
watched the series in school, increased in nutritional sopl^istication more 
than youth in any-other' experimental condition. \ ' 




J 
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CHART Vlliy IMPACT OF COMIC WORKBOOK ON SELECTED MEASUREMENTS 



With Comic 
Wititout Comi 
Control Grou 




No. of Youth 



% Increase in Mean Number Correct dn Nutrition Knowledge 
Test, PreWt to Post-Test . 



4|h Graders 



5th Graders 



6th Graders 



309- 

273 

112 

329 
302 
123 

298 
310 
140 



I 



3% 




40% 



40% 




29% 




% Reduction From Pretest to Post-Test in Mean Preference 
Ratio.of "Empty Calorie" to Nutritious Foods 



4'th Graders 



5th Graders 



6th Graders 



304 
272 
112 

326 
299 
123, 

293 
308 
140 



10% Reducti' 

4% Reduction 

I 3% Increase 



10% Reduction 
7% Reduction 

3% Increase 



10 % Reduction 
4% Reduction 
3% Increase ' 
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• IMPACT FI^?DING ~ tWARENESS OF 4-H 

< '■ 

MULLIGAN STEW HAS A POWERFUL IMPACT ON YOUTH'S AWARENESS/OF 




Chart IX beioV displays the results of this final outcome measure — 
the percent increase in the number of youth aware of 4-hA 



CHART IX. INCWEASE IN AWARENESS OF 4-H 



Experimental Group 
Contror Group 



wmm 



-No. of Youth Youth Aware of 4-H on Post-Test Among Youth Not Aware 

of 4-H on Pretest 



4th Graders 



5th GradQr^ 



6th Graders 



214 
45 



201 
50 



140 
42 



wmmmmmmmmmmmmmmm 



20% c- 



66% 



m 

J 24% 



58% 



'54% 



29% 



A. 
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• • IMPAfcT FINDING — TARGET AUDIENCE 

= 



MULLIGAN' STEW APPEARS TO .BE^ WELL TARGETED TO ITS AUDIENCE, 
BUT THE SHOWS SEEM XO BE MORE EFFECTIVE WITH 4TH AND 5TH 
• GRADE YOUTH THAN WI-TH 6TH GRADED, ; *^ 

'While the youth in all grades learned important .facts akput nutrition 
from watching Mulligan Stew , the 6th graders did. not exhibit any notable 
changes in? their nutrition behavior , except for "empty ca-lorie" food .selection, 
Charts II and V presented earlier in this chapter. demonstrate this reduced 
impact on the sixth graders. 

Further, When asked how they iiked the "shows, youth in the 6th grade 
resp^Ohded/less^^favorably, indicatiiig that the series is more appropriate for 
thosW in the lower -grades. The chart below demonstrates this pronounced 
difference by grade. ^ ' " ■ 



CHART X. PERCENT LIKING MULLIGAN STEW 




' Ex^peTTmehtal Group 




No. of Youth 



4th Graders 



5th Graders 



6th Graders 



525 



544 



528 



85% 



71% 



53% 



ERIC 
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• IMPACT FINDING - 



- READING ABILITY 



"STEW" HAS AN IMPACT EVEN ON POORER STUDENTS, AS MEASURED BY 
READING ABILITY. ^ 

Frequently, programs will have an intact on the better student but 
show no effect on the poorer student. However, as meastured by. reading 
ability both good students and poorer students showed significant gains in 
knowledge about nutrition, as shown in the following chart. 



CHART XI. INCREASE IN NUTRITION KNOWLEDGE ANALYZED BY YOUTH'S READING 
ABILITY 



Experi mentals At or Above 
Grade Level In Reading 

Experi mentals'^elow Grade 
Level In Reading 



w///m 



Control Group 



No. of Youth r % Increase From Pretnt to PottTest In Mean Number Corract 
on Nutrition Knowledge Test . . 



4th Graders 



5th Graders 



6th Graders 



421 
153 
112 

401 
201 
123 

367 
180 
140 



L 



23% 



J 3% 
J 3% 



V//////////////. 



1.33% 



31%: 



18% 



23% 



19% 



8% 



0 IMPACT FINDING '— TEACHERS RATINGS 

TEACHERS ARE POSITIVE IN THEIR REACTIONS TO THE MULLIGAN 
STEW SERIES. 

Teachers participating in this experiment were asked to rate the 
shows on a number of dimensions, using an eleven point scaje ranging from 
"Very Low" (a rating of zero) to "Very High" (rating of ten) . As is shown 
in the chart below, teachers rated the Mulligan Stew shows highest as a 
nutrition-eiiucation source in general", knd lo^st for "how' much this slabw 
helped develop better nutrition behavior among your pupils". These 
opinions appdkr to be validated by the other impact findings discussed 
earlier, in this chapter. (The data in this chart should >fe used with 
caution, however, ' since' the sample size (N=59)' is relatively small.) 



CHART XII. TEACHERS' RATINGS OF THE MULLIGAN STEW SHOWS 



As a Nutrition-Education Source in General 



6,9' 



Based on Level of Interest Shown by Students 



For Helping to Develop Student Interest in Nutrition 



For Helping Create More Positive Attitudes Toward 
Good Nutrition 



For Helping Develop Better Nutrition Behavior 
Among Students 
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IMPACT FINDING — TEACHER INVOLVEMENTy 



SOMEWHAT SURPRISINGLY /:tHE EXTENT OF A TEACHER'S INVOLVE- 
MENT IN FOLLOW-UP ACTIVITIES — FOR' EXAMPLE, PLAYING THE 
SUGGESTED MULLIGAN STEW GAMES IN CLASS — HAS NO NOTICEABLE 
• ■ ' EFFECT ON HOW MUCH THE CHILD LEARNS FROM THE ^ MULLIGAN STEW 

FILMS. 

\ In terms of measurable growth in nutrition knowledge, there does 
, not appeau: to be a marked difference among children which can be traced to 
the participation of their teachers in nutrition-related follow-up activities. 
These activities are set forth in the Teacher's Guide,, which is intended as 
a' supplement to tjie films. According to the content analysis, however, the 
Gnide is iriadequptte. in many ways, nbt the least of vrtiich is the faet that it 
rarely p»resents^ information that has not already been introduced i^ji the films. 
Nor does it augment the -information with additional facts or materials de- 
signed to expand the teachers * , and the classes* basic understanding of the 
subject' matter. Had the Guide included Such additional material, teachers ■ 
might have been more encouraged to pursue follow-up activities, with corres- 
pondingly favorable results. 



# CONTENT ANALYSIS FINDING ' — THE NU TRITION IDEAS PRESENTED 
IN THE FILMS • . 

THE SERIES MENTIONS ALL OF THE CONCEPTS LISTED BY THE GOVERN- 
MENT'S INTERAGENCY COMMITTEE ON NUTRITION EDUCATION AS BEING 
ESSENTIAL TO NUTRITION EDUCATION, ALTHOUGH SOME CONCE^S 
RECEIVE MORE ATTENTION, OR ARE PRESENTED ilORE ACCURATELY, 
THAN OTHERS. * 

T 

As with many attempts to cover a subject area completely, some ideas 
axe presented more accurately and completely than others. A case in point, 
as far as Mulligan Stew is concerned, is the 4-4-3-2 concept. This is the 
concept identified by,USDA nutritionists that an adequate diet for young 
^>eople" should include four servings from the bread and cereal food group. 
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four from the jEruit and vegetable group, three' from the milk group, and 
two from the meat group. each day. Since the 4-4-3-2 concept J.s. predicated 
entitely. on the- concept of "servings", one might expett the series to con- 
centratle on clarifying just what constitutes a, serving. 'While, admittedly, 
this is a difficult idea to present to young children, the idea behind a 
"serving", and what the size of a serving is, is never adequately handled 
at any point in the series. 

The health effects depicted in the series are over-dramatized to 
communicate 'certain points. Such emphasis, however, raises the pptential for 
miscommunicattion. For example, after seeing The Great Nutrition Turn On, 
children may conclude that one thing which can resuj-t from poor nutrition i? 
Lhat persons affected will' fall asleep at odd times and places. Since they 
themselves do not do this, they m^y conclude that they are well-nourished. 

• ^ r 

The presentation of food additives is limited to those which are 
added intentionally (for preservation, enrichment and fortification) . 
Mulligan Stew omits any mention of those added unintentionally, or for 
purely cosmetic purposes. Thus, children may be led to believe that all 
additives are for nutrition purposes alone. 

, CONTENT ANALYSIS FINDING — MULLIGAN STEW'S METHOD OF PRE- 
SENTING INFORMATION ; 
\ ONE OF THE WEAKNESSES NOTED IN MULLIGAN STEW IS THAT SOME 
OF THE ATTENTION-SUSTAINII3G DEVICES, SUCH AS THE PUPPETS, ( 
ARE NOT EFFECTIVELY USED TO REINFORCE THE MAIN EDUCATIONAL J 
MESSAGES OF THE FILMS- . ' 

■ ^ » 

An analysis of how the nutrition information is presented in Mulligan 
Stew indicates that the puppets and cartoons are often non-functional, insofar 
as they fail to reinforce the main points being presented. 

The main presentation technique , that of repetition, does help child- 
ren remember key ideas, but learning by rote can have only very limited 
effects. 
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Attention sustaining devices (e.g., rock music, kid gang, whimsy,* 
slow motion) - are neither intiegrated with the educational message nor 
supportive of it. There is a frequent mismatch between the target audience's 
age .iuid the techniques tised to present information (e.g., puppets). The 
souiad track is poor, and music and visuals tend to overpower the message. 

models create dissonance. This is particularly apparent in 
the modeling of^ Wilbur Doright, for Wilbur is presented as the authority 
figure vrtio knows everything about nutrition. On the other hand, Wilbur is 
also the bbject of constant ridicule by the Mulligan Stew gang. Such contra- 
dictions would appear^^o be counter-productive ^ the objectives of the 
series. . ' 

The series also presents a poor model of eating behavior. Where 
food is concerned, the predominant visual impression is that one rarely sits 
down for meals. Yet considering the narrow range of food available to one 
who eats "on the run", this is hardly a pattern to be encouraged. 

Still another problem in the modeling of the series is that the 
Mulligan Stew gang seem to haye no families or homes — the viewer is not 
told where they get their food; . This "f amililessness" is the most dramatic 
example of the tendency throughout the series to show food removed both 
from its nprmal selection and preparation, and from its usual setting — 
namely, in a family environment a1? meal--J;i^^e. 

V 

• CASE STUDY FINDING — MUjLLIGAN STEW'S DELIVERY SYSTEM 

AS COMPARED TO OTHER 4-H OUTREACH METHODS, "STEW" REACHED' 
AND SIGNED UP LARGE JJUMBERS OF CHILDREN AS 4-H TV MEMBERS 
AT AN EXCEEDINGLY LOW COST PER CHILD. 

In assessing costs for Mulligan Stew in each of the six case studies, 
the costs at the federal level, i.e., research and development, were sxfot 
factored in. The total estimated costs for Extension Service, USDA were 
$716,000. The federal contribution to this effort is itemized as follows: 

3t 
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Comprehensive Plan $10,000 

Production ■ , 

Films 301,000 

Supportive Materials . V 45,000 



f nv 



Duplication - Distribution - Reporting 346,000 

Evaluation 129,231 

Estimated staff time @ $25K/year: ' 137,500 

I Development of Preliminary plan - 

(1 Man year) 
II. Production of Films and Materials - 

(2]t' Man years) 
III Distribution, training, promotion - 
V . (1^5 Man years) 

IV Research r ^ ( 'a^Man years) 

National 4-H Service Committee staff time 
for distribution and prompt 
(Administration, Profession^] Secretarial, 




r 



Accounting, Shipping and BilJ 

Fiscal year 1973. ' ^1^, $26,000 

^ Since 4,000,000 4-H TV members haveM^een enrolled nationally to- 

aate for the MulliganrStew program, the federal contribution to the per 
child cost equals 18<:. ^ 

In addition, the Outreach procedures used for Mulligan Stew cost 
the State Extension Services less than 80<: per child? these procedures in- 
cluded enrolling youth as 4-H TV members. (The State Extensions' costs, by 
the way, do not include a substantial amount of goods and services that were 
donated to Mulligan Stew — for example, free broadcast time, and volunteer 
time put in by teachers — which amounted to 42<: per youth, on the * average . ) 

t 

Thus, when the federal contribution is added to the State's Extension 
costs, the enrollment costs for Mulligan Stew amounts to less than $1.00 ^per 
youth. • / 

TO enable some rough- cost comparisons with other 4-H programs to be 
made, USDA provided the following cost information: looking at all 4-H 

33 . 
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costs/expenditures (including overhead costs within 4-H, but excluding 

overhead in othef parts of . Extension) , the average cost per enrollee 

per project is $10. 48, Thus, sihce Mulligan Stew's outreach program — 

at less. than $1.00 per youth — reached such large numbers of youth, its 

"per youth" cost is only about one-tenth of other 4-H programs. Unfortunately # 

however, there was little effort to capitalize on this program by attempting 

f 

to move 4-H TV members into other 4-H projects. 

As of October, 1974 the six states reported that between 20% and 90% 
of all 4th, 5th, and 6th grade children had become 4-H TV members via 
Mulligan Stew . T^e table below details this finding: , 



State 



Arkansas 
Missouri 
Oregon 

Pennsylvania 

Tennessee 

Texas 



Number of 4th, 
5th, 6th grade 
children in State 

112,000 
270,000 

N/A 
650,000 
147,000 
687,000 



Number of 4th, 
5th, 6th grade 
children reached 
by Mulligan Stew 

103,000 
171,000 

N/A 
205,224 
, 65,000 
117,000 



% of 4th, 5th, 
6th grade child- 
ren reached by 
Mulligan Stew* 

90% 
60% 



30% 
^45% 
20% 



It would be interesting and ^^opriate for Extension Service to 
compare this capture rate with other programs In order to measure relative 
effectiveness of outreach. 



Rounded to nearest 5%. 
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^ CASE STUDY FINDING ~ IMPACT PF^ "STEW" ON EXTENSION 
SERVICE 

MULLIGAN STEW HAS IMPROVED EXTOENSlON ' S IMAGE NOT ONLY 

— ' • f 1 ' 

WITH TV BROADCASTERS AND TI?E ePU(i\TIONAL COMMUNITY, 
BUT WITH ITS OWN AGENTS AS WELL. 

Agents have reported comments ^orii TV station personnel and from .jjjf 
the public suggesting that they "didn't Wow Extension was anything but 
agriculture." New and' potentially valuables relationships have beenj;estab 
lished With the educational community and Vhe TV broadcasters. ^ T 

In addition, Mulligan Stew has served as a morale builder fo^^ many 
agents who experienced success and a new senSe of professional compete^c^e 
as a result of their involvement in the project. \-: 



\ 
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CONCLUSIONS AND RECOMMENDATIONS 

CONCLUSIONS ^ 

Basecf upon our analysis of the data from the impact study. Mulligan 
Stew has had a positive impact on youth. 

After participating in the TV series , youth demonstrate more know- 
ledge about nutrition, are more likely to engage in nutrition-related 
activities, such as prieparihg food with a friend, and exhibit a dramatic 
increase in their awareness of 4-H. Since these results were identified 
as major goals of the series, it can be stated that Mulligan Stew has had 

a positive impact on its viewers. 

' > 

It must be added, however, that the shows do not fully meet all of 
the stated objectives. For example. Mulligan Stew generates only minimal 
changes in the nutrition behavior of youth? while the youth who view the 
series do appear to eat more for breakfast, their selections from the basic 
four food groups (i.e., meat, milk, fruit and vegetables, bread and cereals) 
seem to remain unchanged. * 

On the other hand, the series does seem to raise youth's awareness 
of the concept of "empty calorie" foods — foods that contain calories, but 
have little nutritional content*^ After participating in Mulligan Stew , 
youth in all three grades tended to select fewer "empty calorie" items when 
given free choice on a menu containing a large number of foods. 

As measured by reading ability, the series Works well both with the 
good student and the poorer student too. And while the series appears to 
be effective with youth in all three grades, overall Mulligan Stew has a 
somewhat stronger impact q|i fourth and fifth graders than it does on sixth 
grade youth. 

And finally, the comic workbook and viewing situation appear to be 
important variables; although at-home viewing is good, iri-schoo! viewing 
generates larger changes; and, while the series works well without the comic 
workbook, "Stew" ^is more effective with the comic. 
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RECOMMENDATIONS 



Policy Recommendations 

• WB RECOMMEND THAT TV PROGRAMMING CONTINUE TO BE USED 
BY THE EXTENSION SERVICE;^ ^ • ^ 

\ 

We have reached this first recommendation for several reasons. 
Firstly, Mulligan Stew has had a good impact on its target audience. And 
while this, in itself, does not guarantee future productions to also have 
a positive impact, "Stew" has /amply demonstrated the ability. of the TV 
jmedi\Hn. 

secondly. Mulligan Stew has created a receptive audience for E^c- 
tension — broadcasters, teachers, state and local school administration, ai 
of course, the youth themselves. \ 

\ . ^ 

Importantly, "Stew's" cost-effective outreach procedures does not 
seem to be unique to this TV series alone ,^,,*ut appears to be a character- 
istic advantage of. this mass medium. 

# WE RECOMMEND THAT FUTURE PROGRAM GOALS AND OBJECTIVES BE 
MORE CONSISTENT WITH THE POTENTIAL OF THE INSTRUMENT 
SELECTED TO ACHIEVE THEM. 

The educational objectives and organizational objectives set for 
Mulligan Stew appear to have bee^ far too optimistic, considering that the 
series consists of only three hours of shows, plus supplementary teaching- 
Itearning materials. 

in a sense, youths are constantiy being presented with nutrition 
information. By th^ time (s)he is ten years old, the average child will 
have had thou^nds of meals and snacks, will have visited supermarkets 
hundreds of times, and will have been given thousands or bits of nutrition 
informktion - or misinformation - from friends, television commercials, 
and box tops. If we make the conservative assumption, then, that the 

33 
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average youth has received one thousand hours of "training" in nutrition 

' III 

from all of the above-mentioned- activities , it would' appear that many 
habits have been established even at this young age. Hioman behavior is not 
easily changed, and to expect substantial changes to be made in people's 
habits on the^basis of a few hours of TV viewing appears to be unrealistic. 

Furthermore, it would appear that objectives that emphasize estab- 
lishing new habits will- probably create less cognitive dissonance and, thus, 
will be more effective than trying to change old ones. For example, Mulligan 
Stew did not appear to waste its resources by emphasizing that "empty calorie" 
foods are bad; instead, the series emphasized why nutritious food was needed. 



# WE STRONGLY URGE THE EXPANSION OF EVALUATION ACTIVITIES 
INTO OTHER PROGRAM COMPONENTS OF EXTENSION SERVICE. 



An important use of evaluation is for policy decisions, such as 
the establishment of program priorities and the allocation of budgets. 
Unfortunately, it is difficult to compare the evaluation of Mulligan vStew 
with information on other programs in Extension Service to allow priori- 
ties and optimally allocated budgets to be established on the basis of 
current^data. There appears to be a paucity of other studies within Extension 
Service to which to relate the Mulligan Stew findings. 
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TV Progrctinming Recommendations ' 

Should TV programming continue, a number of recommendations are in 
order. These concern the research and development components, an^ the dis 
tribution component. 

Research atid Development (R&D) ■ In-order to ensure high quality 
in future R&D efforts, the following' steps must be taken: 

• Select future subject areas for TV E(rograiraning that 
satisfy at least two criteria:' that the subject be 
of interest to both teachers and children, and that 

^ there be a paucity of high quality curriculum ma- 
terials on the subj ect currently in use ^n the schools - 

• Develop reasonable, realizable goals and objectives 
for the program" 

♦ 

• Operationalize these goals to^a degree of specificity 
that makes for easy translation to the TV media, and 
which facilitates evaluation of the program. 

V '■' ^ " * 

• Develop auxiliary materials which both reinforcfe and 
expand on the message of the^ shows, learning by doing 
activities should be emphasized. 



Use an R&D staff organization which includes a cur- 
riculum specialist, a subject specialist arid a TV 
production/film specialist. The interface between^ 
curriculum and production specialists is essential. 

Engage in formative q|(||auation, that is, testing the 
production on the targ^-, audience at all phases of ^ 
the conceptualization and" production. Feedback at 
all stages in. the series development will improve 
all the shows as well as those later in. the series. 



Distribution Component . We further recommend a number of actions 
that will ensure smooth, cost-effective delivery, of future progtoming 



Within a framework of limited resources. Mulligan Stew 
is most productively used in group situation's. The group 
situation used in 'this, study, i.e., schools, is not the 
only typ/'of structure situation possible. Indeed Mulligan- 
Stew can[ easily: lend' itself to a week- long nutrition camp 
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or be a six week se^ent of a 4-H club or special interest 
group". However, the number of children reachable through 
the schools is so great that this ^^uld appear to be a 
preferred approach. We recommend then that any future TV 
programming should continue to focus on t}\e schools as its. 
primary delivery mechanism. There must be a close working 
relationship between those staff who are arranging TV place- 
•ment and those who are responsible for school contact and 
delivery of materials. The success of Mul^gan Stew in any 
site depends on the interaction between TV schedules and 
school schedules. 

^ ■ «• 

Lead time must be sufficient both^for placement of the program 
arte training of Extension staff. Lead time between training 
of Extension staff and airing of the program should be not 
less than two months or more than five months. 

* 

There was little evidence of promotional a(?tivities outside 
of the schools. Thus, the opportunity , to carry the message 
of the program, and thereby Extension', to a larger audience 
was lost. In future pro^amming, promotion should be part 
of the planned activities. 

Other follow-up activities should include moving 4-H TV 
members into other 4-H programs. While the shows were 
excellent promotional as well as educational devices, the4^r 
outreach potential has not been fully realized. Follow-ufJ 
activities should be part of the overall j^lannirig. 



A FINAL NOTE 



in the past, Extensipn Service has s\abscribed* to the ideal of defin- 
ing in advance the specific objectives of a proposed program. Such. objectives, 
arrived' at by consensus, are very useful in identifying the limits and defin- 
ing the parameters of a program. Used after the fact, "as an evaluation tool, 
these objectives then become the criteria upon which to base a judgment as . 
to the succe&s of the program. The achievement of these objectives within 
a specified time frame constitutes "success'*. 

•The Mulligan Stew program, on the other hand, was defined in terms 
pf generalized goals,- irallier than specific objectives. Thdse goals, however, 
could not be automatically translated into operationalizable objectives. 
Thus it becomes more difficult to evaluate the success of the program in ^ 
terms of any organized criteria. By recommending that TV programming of 
the series continue, however, Abt Associates is in fact indicating that 
criteria have been identified by which the success of the program may be 

■ ' % 

measured. These are: 

- The impact of the series: positive changes in knowledge, 
awareness and selected behaviors in subjects \^o saw the 
program as compared with subjects v^o did not 

- Cost^f actors : the lower cost per child for the Mulligan 
' • Stew package cOTipared with the cost per child for other 

4-H programs 

- The continued interest expressed by state 4-H staff, 
teachers, principals , ^ and TV stations in additional 
4-H TV pro^amming . . ^ 

Even though these criteria werp arrived at after the fact,- they 
would appear to be appropriate, and the data acquired by Abt Associates for 
evaluating the program on the basis of these criteria wojild allow a valid 
judgment of ^e success of Mulligan Stew to be made. 
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